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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments witli respect to claims 1 - 20 have been considered but are 
moot in view of tlie new ground(s) of rejection. 

Applicant argues neither Bennett nor Johnson teach assigning the speech 
utterance to a single ASR engine when the plurality of different ASR engines are busy 
such that assessing resources is within a threshold value; assigning the speech 
utterance to a plurality of different ASR engines when the plurality of different ASR 
engines are not busy such that assessing resources is within a threshold value 
(Amendment, pages 6 - 8). 

The examiner agrees, but the claims are now rejected in view of new grounds of 
rejection. Please see claim rejection below. 

Claim Rejections - 35 USC § 103 

2. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

3. Claims 1 - 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bennett et a!., (US PAP 2002/0193991) in view of Johnson (US Patent 6, 728,671), and 
further in view of Watanabe et al., (US Patent 4,641 ,342). 

As per claims 1 , 8, and 14, Bennett et al., teach an automatic speech recognition 
(ASR), that comprises: 
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receiving a speecli utterance from a user ("the input stream is received"; 
paragrapli 23, line 3); 

generating text of tine speecli utterance witli eitlier tine single ASR engine or 
plurality of ASR engines ("individual result sets are then coalesced"; paragraph 26, lines 
1, and 2). 

However, Bennett et al., do not specifically teach assessing resources of each of 
a plurality of different ASR engines to determine which of the plurality of different ASR 
engines are busy serving users; assigning the speech utterance to a single ASR engine 
when the plurality of different ASR engines are busy such that assessing resources is 
within a threshold value; assigning the speech utterance to a plurality of different ASR 
engines when the plurality of different ASR engines are not busy such that assessing 
resources is within a threshold value. 

Johnson et al., teach determining whether the usage level of the ASR input 
channels is greater than a first predetermined threshold, such as 75% threshold; and 
monitoring an energy level of a caller input channels. Various advantages of the 
present invention include actually serving a caller by an interactive system, without 
placing the caller on hold and without loss of the call, while all ASR input channels are 
busy serving other callers (col.8, lines 37 - 40; Abstract, lines 16-18; col.2, lines 41 - 
45). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to determine whether or not the recognizers are available 



Application/Control Number: 10/668,141 Page 4 

Art Unit: 2626 

as taught by Johnson et al., in Bennett et a!., because that would help better rout the 
stream input. 

However, Bennett et al., in view of Johnson et al., do not specifically teach 
assigning the speech utterance to a single ASR engine when the plurality of different 
ASR engines are busy such that assessing resources is within a threshold value; 
assigning the speech utterance to a plurality of different ASR engines when the plurality 
of different ASR engines are not busy such that assessing resources is within a 
threshold value. 

Watanabe et al., teach detector can also be used to selectively switch an active 
one of a plurality of user channels to one of a smaller number of voice recognizers. The 
control means searches for any idle input terminal 121- 12n at the recognition means. 
...when an idle terminal is found, the change-over switch 14 operates to connect the 
requested user channel with the idle recognition input terminal. A change-over switch 
14 connects m voice pattern outputs to n separate recognition input terminals 121 , 122, 
. . . , 12j, . . . , 12n of a recognition means 15 which recognizes the voices received on 
its n separate recognition input terminals as the outputs from the change-over switch 
14. The recognition means 15 can recognize n separate voice simultaneously 
(Abstract, lines 7- 10; col .4, lines 5- 12, and 36-46; col .6, lines 4-6). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to recognize n separate voices simultaneously using a 
single recognizer as taught by Watanabe et al in Bennett et al., because that would 
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provide a voice input system improved to avoid a mis-recognition or a rejection (col.1 , 
lines 29 - 32). 

As per claims 2, and 9, Bennett et al., in view of Johnson et al., and further in 

view Watanabe et a!., further disclose monitoring port utilization for each ASR engine 
(Johnson; "usage level of the ASR Input"; col.8, lines 37 - 40). 

As per claims 3, and 10, Bennett et al., in view of Johnson et al., and further in 
view Watanabe et al., further recite evaluating processing power (Johnson; "detect 
energy"; col.5, lines 26 - 28). 

As per claim 4, Bennett et al., in view of Johnson et al., and further in view 
Watanabe et al., further disclose monitoring memory utilization and input/output 
utilization (Johnson; "memory buffer"; col.2, lines 23 - 25). 

As per claim 5, Bennett et al., in view of Johnson et al., and further in view 
Watanabe et al., further disclose monitoring a number of users providing speech 
utterances (Johnson; "active calls, as those callers"; col.4, lines 3 - 8). 

As per claim 6, and 7, Bennett et al., in view of Johnson et al., and further in view 
Watanabe et al., further suggest determining if assessing resources is within a threshold 
value occurs when port utilization of the single ASR engine is lower than a port 
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utilization threshold of about 80%; if assessing resources is within a threshold value 
occurs when port utilization of two ASR engines is lower than a predefined threshold of 
about 75% (Johnson; "greater than a first predetermined threshold, such as 75% 
threshold "; col.8, lines 37-40; Abstract, lines 16 - 18). 

As per claim 1 1 , Bennett et al., in view of Johnson et al., and further in view 
Watanabe et al., further disclose combing results of ASR engines if the group of ASR 
engines is selected, the group of ASR engines being adapted to provide a more 
accurate recognition of the utterance than a single ASR engine (Bennett et al., 
"individual result sets are then coalesced"; paragraph 26, lines 1 - 3; paragraph 43, 
lines 1 - 3). 

As per claim 12, Bennett et al., in view of Johnson et al., and further in view 
Watanabe et al., further disclose evaluating resources of the system evaluates 
resources to simultaneously run multiple ASR engines (Bennett; "simultaneous use of 
three machine speech recognition systems"; paragraph 31, lines 10-12). 

As per claim 13, Bennett et al., in view of Johnson et al., and further in view 
Watanabe et al., further disclose evaluating resources of the system evaluates ASR 
ports, system resources and call handlers (Johnson; "usage level of the ASR input"; 
col.8, lines 37 - 40; col.4, lines 3 - 8). 
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As per claim 15, Bennett et al., in view of Jolinson et a!., and further in view 
Watanabe et a!., further disclose selecting an ASR engine that has most available 
resources (Bennett; "high accuracy"; paragraph 20, lines 7 - 9). 

As per claims 16, and 17, Bennett et a!., in view of Johnson et al., and further in 
view Watanabe et al., further disclose a telephone network comprising at least one 
switching service point coupled to the computer system, wherein at least one 
communication device in communication with the switching service point to provide the 
speech utterance (Watanabe; col.4, lines 36 - 46). 

As per claims 18-20, Bennett et al., in view of Johnson et al., and further in view 
Watanabe et al., further disclose that the resource management application comprises a 
recognition proxy component and a resource monitoring component, wherein the 
resource management component collects and analyzes information about the 
resources available on the system, and wherein the resource monitoring component 
mediates between the plurality of ASR engines and the resource management 
component (Johnson; "determining whether the usage level of the ASR input channels 
is greater than a first predetermined threshold, such as 75% threshold; and monitoring 
an energy level of a caller input channel"; col.8, lines 37 - 40; Abstract, lines 16-18). 

Conclusion 

4. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. See PTO-892 Form. 
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5. Any inquiry concerning this communication or earlier communications from tine 
examiner should be directed to LEONARD SAINT CYR whose telephone number is 
(571 ) 272-4247. The examiner can normally be reached on Mon- Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is (571)- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

LS 

11/25/08 

/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



